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Abstract. In this paper, we present a randomized polynomial-time approximation algorithm for MAX 
fc-CSPd- In MAX fe-CSPd, we are given a set of predicates of arity k over an alphabet of size d. Our 
goal is to find an assignment that maximizes the number of satisfied constraints. 

Our algorithm has approximation factor (2{kd/d k ) (when k > l?(logd)). This bound is asymptotically 
optimal assuming the Unique Games Conjecture. The best previously known algorithm has approxi- 
mation factor fi(k\ogd/d k ). 

We also give an approximation algorithm for the boolean MAX fc-CSP2 problem with a slightly improved 
approximation guarantee. 



1 Introduction 

We design an approximation algorithm for the MAX /c-CSP^, the maximum constraint satisfaction 
problem with k-ary predicates and domain size d. In this problem, we are given a set of variables 
{x u } U £x and a set of predicates V . Each variable x u takes values in [d] = {1, . . . , d}. Each predicate 
P £ V depends on at most k variables. Our goal is to assign values to variables so as to maximize 
the number of satisfied constraints. 

There has been a lot of interest in finding the approximability of MAX fc-CSP^ in the com- 
plexity community motivated by the connection of MAX /c-CSP^ to fc-bit PCPs. Let us briefly 
overview known results. Samorodnitsky and Trevisan [9] showed that the boolean MAX &-CSP2 
problem cannot be approximated within a factor of Q{2 2 ^ k /2 k ) if P 7^ NP. Later Engebretsen and 
Holmerin [5] improved this bound to fl(2r^ /2 k ). For non-boolean MAX /c-CSP^, Engebretsen [4] 
proved a hardness result of 2°( v ^ jd k . Much stronger inapproximability results were obtained as- 
suming the Unique Games Conjecture (UGC). Samorodnitsky and Trevisan [10] proved the hardness 
of 0(k/2 k ) for the boolean MAX /C-CSP2. Austrin and Mossel [1] and, independently, Guruswami 
and Raghavendra [6] proved the hardness of 0(kd 2 /d k ) for non-boolean MAX /c-CSP^. Moreover, 
Austrin and Mossel [1] proved the hardness of 0(kd/d k ) for every d and infinitely many k; specif- 
ically, their result holds for d and k such that k = (d l — l)/{d — 1) for some t € N. Very recently, 
Hastad strengthened the result of Austrin and Mossel and showed the hardness of 0(kd/d k ) for 
every d and k > d [private communication]. 

On the positive side, approximation algorithms for the problem have been developed in a series 
of papers by Trevisan [12], Hast [7], Charikar, Makarychev and Makarychev [3], and Guruswami 
and Raghavendra [6]. The best currently known algorithm for Ai-CSP^ by Charikar et al [3] has 
approximation factor of Q(k\ogd/d k ). Note that a trivial algorithm for MAX fe-CSP^ that just 
picks a random assignment satisfies each constraint with probability at least l/d k , and therefore 
its approximation ratio is l/d k . 

The problem is essentially settled in the boolean case. We know that the optimal approximation 
factor is ©{k/2 k ) assuming UGC. However, best known lower and upper bounds for the non-boolean 
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case do not match. In this paper, we present an approximation algorithm for non-boolean MAX 
fe-CSPrf with approximation factor fi{kd/d k ) (for k > f2(\ogd)). This algorithm is asymptotically 
optimal assuming UGC — it is within a constant factor of the upper bounds of Austrin and Mossel 
and of Hastad (for k of the form (<i* — l)/(d — 1) and for k > d, respectively). Our result improves 
the best previously known approximation factor of Q(k\ogd/d k ). 

Related work Raghavendra studied a more general MAX CSP(7 3 ) problem [8]. He showed 
that the optimal approximation factor equals the integrality gap of the standard SDP relaxation 
for the problem (assuming UGC). His result applies in particular to MAX fc-CSP^. However, the 
SDP integrality gap of MAX fc-CSP^ is not known. 

Overview We use semidefinite programming (SDP) to solve the problem. In our SDP relax- 
ation, we have an "indicator vector" u\ for every variable x u and value i; we also have a "indicator 
vector" zc for every constraint C. In the intended solution, U{ is equal to a fixed unit vector e if 
x u = i, and ui = if x u ^ i; similarly, zq = e if C is satisfied, and zq = 0, otherwise. 

It is interesting that the best previously known algorithm for the problem [3] did not use this 
SDP relaxation; rather it reduced the problem to a binary fc-CSP problem, which it solved in turn 
using semidefinite programming. The only previously known algorithm [6] that directly rounded an 
SDP solution for MAX fc-CSP^ had approximation factor ft (~^ir)- 

One of the challenges of rounding the SDP solution is that vectors Ui might have different 
lengths. Consequently, we cannot just use a rounding scheme that projects vectors on a random 
direction and then chooses vectors that have largest projections, since this scheme will choose longer 
vectors with disproportionately large probabilities. To deal with this problem, we first develop a 
rounding scheme that rounds uniform SDP solutions, solutions in which all vectors are "short". 
Then we construct a randomized reduction that converts any instance to an instance with a uniform 
SDP solution. 

Our algorithm for the uniform case is very simple. First, we choose a random Gaussian vector 
g. Then for every u, we find U{ that has the largest projection on g (in absolute value), and let 
x u = i. However, the analysis of this algorithm is quite different from analyses of similar algorithms 
for other problems: when we estimate the probability that a constraint C is satisfied, we have to 
analyze the correlation of all vectors Ui with vector zc (where {ui} are SDP vectors for variables 
x u that appear in C, zc is the SDP vector for C), whereas the standard approach would be to look 
only at pairwise correlations of vectors {u{\; this approach does not work in our case, however, since 
vectors corresponding to an assignment that satisfies C may have very small pairwise correlations, 
but vectors corresponding to assignments that do not satisfy C may have much larger pairwise 
correlations. 

Remark 1.1. We study the problem only in the regime when k > J?(logd). In Theorem 5.1, we 
prove that when k = O(logd) our algorithm has approximation factor e n ^/d k . However, in this 
regime, a better approximation factor of Q{d/d k ) can be obtained by a simple greedy approach. 

Other Results We also apply our SDP rounding technique to the Boolean Maximum CSP 
Problem. We give an algorithm that has approximation guarantee « 0.62 k/2 k for sufficiently large 
k. That slightly improves the best previously known guarantee of « 0A4k/2 k [3]. We present this 
result in Appendix B. 
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2 Preliminaries 



We apply the approximation preserving reduction of Trevisan [12] to transform a general instance 
of MAX fc-CSPrf to an instance where each predicate is a conjunction of terms of the form x u = i. 
The reduction replaces a predicate P, which depends on variables x vi , . . . , x Vk , with a set of clauses 

{(x Vl = h) A ■ ■ • A (x Vk = i k ) : P(h, . . . , i k ) is true} . 

Then it is sufficient to solve the obtained instance. We refer the reader to [12] for details. We assume 
below that each predicate is a clause of the form (x Vl = i\) A • • • A (x Vk = i k )- 

Definition 2.1 (Constraint satisfaction problem). An instance! of MAX CSPd consists of 

— a set of "indices" X , 

— a set of variables {x u } ue x (there is one variable x u for every index u G X), 

— a set of clauses C. 

Each variable x u takes values in the domain [d] = {l,...,d}. Each clause C G C is a set of 
pairs (u,i) where u G X and i G [d]. An assignment x u = x* satisfies a clause C if for every 
(u,i) G C, we have x* = i. We assume that no clause C in C contains pairs (u,i) and (u,j) with 
i 7^ 3 ( no assignment satisfies such clause). The length of a clause C is |C|. The support of C is 
supp(C) = {u : (u,i) G C}. 

The value of an assignment x* is the number of constraints in C satisfied by x*. Our goal 
is to find an assignment of maximum value. We denote the value of an optimal assignment by 
OPT = OPT(l). 

In the MAX k-CSPd problem, we additionally require that all clauses in C have length at most k. 

We consider the following semidefinite programming (SDP) relaxation for MAX CSP^. For 
every index u G X and i G [d], we have a vector variable Ui\ for every clause C, we have a vector 
variable zq- 

maximize: II ^dl 2 
Cec 

subject to 

d 

||^j|| 2 < 1 for every u G X 

i=l 

(ui, Uj) =0 for every u£ X,i,j G [d] (i / j) 

(ui,zc) = \\zc\\ 2 for every C G C, (u,i) G C 

(uj,zc) = for every C G C, (u, i) G C and j / i 



Denote the optimal SDP value by SDP = SDP(Z). Consider the optimal solution x* to an instance 
X and the corresponding SDP solution defined as follows, 

I e, if x* = i; J e, if C is satisfied; 

Ui = < zc = < 

10, otherwise; 10, otherwise; 

where e is a fixed unit vector. It is easy to see that this is a feasible SDP solution and its value 
equals OPT(X). Therefore, SDP{X) > OPT{X). 
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Definition 2.2. We say that an SDP solution is uniform if \\ui\\ 2 < l/d for every u G X and 
ie[d]. 

Definition 2.3. Let £ be a standard Gaussian variable with mean and variance 1. We denote 

1 /"* 

<f>(t) = Pr (|£| < t) = -== / e~ x2/2 dx, and 

V27T 

#(t) = l-#(t)=Pr(|£|>t). 
We will use the following lemma, which we prove in Appendix. 
Lemma 2.1. For every t > and (3 G (0, 1] , we /tave 

We will also use the following result of Sidak [11]: 

Theorem 2.1 (Sidak [11]). Let £i, . . . ,£ r 6e Gaussian random variables with mean zero and an 
arbitrary covariance matrix. Then for any positive t±, . . . , t r , 

r 

Pr(|6| <*1,|&I <t 2 ,..-,\&\ <tr) >n Pr d^l ^**)- 

i=l 

3 Rounding Uniform SDP Solutions 

In this section, we present a rounding scheme for uniform SDP solutions. 

Lemma 3.1. There is a randomized polynomial-time algorithm that given an instance Z of the 
MAX CSPd problem (with d > 57) and a uniform SDP solution, outputs an assignment x u such 
that for every clause C G C: 

rw^ • ■ n , , n min(||z c || 2 |C|d/8,el c l) 
Pr (C is satisfied by x u ) > v " 2 ^ c \ -■ 

Proof. We use the following rounding algorithm: 



Rounding Scheme for Uniform SDP solutions 

Input: an instance of the MAX CSP^ problem and a uniform SDP solution. 
Output: an assignment {x u }. 

— Choose a random Gaussian vector g so that every component of g is distributed as a Gaussian 
variable with mean and variance 1, and all components are independent. 

— For every u eV, let x' u = argmax^ \(ui,g)\. 

— For every u £ V, choose x" u uniformly at random from [d] (independently for different u). 

— With probability 1/2 return assignment {x' u }; with probability 1/2 return assignment {x"}. 



For every clause C, let us estimate the probabilities that assignments x' u and satisfy C. It is 
clear that x" u satisfies C with probability aH^l We prove now that x' u satisfies C with probability 
at least cT 3 ^/ 4 if \\zf c > 8/(\C\d). 
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Claim. Suppose C G C is a clause such that \\z\\q > 8/(|C|d) and d > 57. Then the probability 
that the assignment x' u satisfies C is at least d -3 ^/ 4 . 

Proof. Denote s = \C\. We assume without loss of generality that for every u G supp(C), («, 1) G C. 
Note that for (u,i) G C, we have H^cll 2 = ( z C'i u i) ^ ll^cll " \\ u i\\ ^ ll^cll/V^ (here we use that the 
SDP solution is uniform and therefore ||iii|| 2 < l/d). Thus ||^c|| 2 < V^- ^ n particular, s = \C\ > 8 
since \\z\\ 2 c > 8/(\C\d). 

For every u G supp(C), let = ui — zc. Let 7 U) i = (g,u^) and 7 U; j = (g,Ui) for i > 2. Let 
7c = (ffj ^c)- All variables 7 u ,i,7c are Gaussian variables. Using that for every two vectors v and 
w, E [(5, v) • (5, it;)] = {v, w), we get 

E[7C • 7«,i] = (zc^i - z c ) = {zc,ui) - \\z c \\ 2 = 0; 
E [7c ■ lu,i] = {zc, Ui) = for i > 2. 

Therefore, all variables j Ut i are independent from jc- (However, for v! , u" G supp(C) variables -f u > j 
and 7 u //j are not necessarily independent.) Let M = <P~ 1 (l/d s / 2 )/^/sd/8. We write the probability 
that satisfies C, 

Pr (x' u satisfies C) = Pr(argmaXj \ (g, ui) \ = 1 for every u G supp(C)) 

= Pr (|(si,ui)| > |(5,«i)| for every u G supp(C),i G {2, . . .,d}) 
= Pr (hu,i + 7C*I > \lu,i\ for every u G supp(C), i G {2, . . . , d}) 
> Pr(|7u,i| < M /2, and | 7ttji | < M/2 

for every u G supp(C), i G {2, . . . , d} \ \^ c \ > M) • Pr (| 7c | > M) . 

Since all variables 7tl j are independent from 7c, 

Pr (x' u satisfies C) > Pr (|7 Uji | < M/2 for every u G supp(C), i G {1, . . . , d}) ■ Pr (| 7c | > M) . 
By Sidak's Theorem (Theorem 2.1), we have 

d 

Pr(x' u satisfies C) > ( [] II Pr (l^l ^ M / 2 )) ' Pr d^l > M) . (1) 

uSsupp(C) i=l 

We compute the variance of vectors 7uj j. We use that Var[(<7, f )] = ||-u|| 2 for every vector v and that 
the SDP solution is uniform. 

Var[7 u> i] = \\u^\\ 2 = - z c \\ 2 = \\ui\\ 2 - 2(u 1 ,z c ) + H^cll 2 = ||-ui|| 2 - ||^c|| 2 < ||^i|| 2 < 
Var[ 7ni j] = ||uj|| 2 < 1/d for i > 2. 

Hence since #(t) is an increasing function and $((3i) < 3(f) 132 (by Lemma 2.1), we have 

Pr (|7„,i| < M/2) = £(M/(2^Var[ 7uii ])) > <P(VdM/2) = 1 - $(VdM/2) 
> 1 - $(yGd/8M) 2 / s = 1 - (cT s / 2 ) 2 / s = 1 - cT 1 

(recall that we defined M so that ®(^sd/8M) = cT s / 2 ). Similarly, Var[ 7c; ] = ||zc|| 2 > 8/(sd) (by 
the condition of the lemma). We get (using the fact that &(t) is a decreasing function), 

Pr(| 7c | > M) = ^(M/v/Vaxf-yc]) > <P(M^/sd/8) = d' 3 / 2 . 
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Plugging in bounds for Pr(|7 Uj j| < M/2) and Pr(|7c| > M) into (1), we obtain 

Pr (x' u satisfies C) > (1 - d" 1 )^ - */ 2 > d~ 3s/4 . 

Here, we used that (1 - dr l ) d > d" 1 / 4 for d > 57 (the inequality (1 - d _1 ) d > d _1/4 holds for 
d > 57 since it holds for d = 57 and the left hand side, (1 — d^ 1 ) d , is an increasing function, the 
right hand side, d _1//4 , is a decreasing function). □ 

We conclude that if ||^c|| 2 < 8/(| C|cZ) then the algorithm chooses assignment x" u with probability 
1/2 and this assignment satisfies C with probability at least l/d) c \ > \\zc\\ 2 \C\ d/(8 S c \). So 
C is satisfied with probability at least, l/S c \ > \\z c \\ 2 \C\ d/(16 A c \); if ||z c || 2 > 8/(|C|d) then 
the algorithm chooses assignment x' with probability 1/2 and this assignment satisfies C with 
probability at least d _3|c,|/4 > e\ c \/S c \ (since e < 57 1/4 < <i 1/4 ). In either case, 

P r (C, SS at lsfi ed)>=*£e»5). 

□ 

Remark 3.1. We note that we did not try to optimize all constants in the statement of Lemma 3.1. 
By choosing all parameters in our proof appropriately, it is possible to show that for every constant 
e > 0, there is a randomized rounding scheme, 5 > and do such that for every instance of MAX 
CSPd with d > do the probability that each clause C is satisfied is at least min((l — e)||zc|| 2 ■ 
|C|d,(S-e*l c l)/dl c l. 

4 Rounding Arbitrary SDP Solutions 

In this section, we show how to round an arbitrary SDP solution. 

Lemma 4.1. There is a randomized polynomial-time algorithm that given an instance I of the 
MAX CSPd problem (with d> 113) and an SDP solution, outputs an assignment x u such that for 
every clause C G C: 

r> m ■ rcjh ^ min(||z c || 2 |C|d/64,2el g l/ 8 ) 

Pr [C is satisfied by x u ) > — — — -. 

4dl°l 

Proof. For every index u, we sort all vectors Ui according to their length. Let S u be the indices of 
[~d/2] shortest vectors among m, and L u = [d] \ S u be the indices of [d/2\ longest vectors among 
Ui (we break ties arbitrarily). For every clause C let r(C) = \ {(u, i) G C : i G S u } \ . 

Claim. For every i G S u , we have ||uj|| 2 < 1/|5 U |. 

Proof. Let % G S u . Note that \\ui\\ 2 + YljeL u \\ u j\\ 2 — ^ (*^ s follows from SDP constraints). There 
are at least |~d/2] terms in the sum, and ||«j|| 2 is the smallest among them (since i G S u ). Thus 

n^iii 2 < i/r^/21 = □ 

We use a combination of two rounding schemes: one of them works well on clauses C with 
r{C) > |C|/4, the other on clauses C with r(C) < \C\/4. 



6 



Lemma 4.2. There is a polynomial-time randomized rounding algorithm that given an MAX CSP^ 
instance X with d > 113 outputs an assignment x u such that every clause C with r(C) > \C\/A is 
satisfied with probability at least 

min(||z c || 2 |C|ri/64,el c l/ 4 ) 
2d)C\ " 

Proof. We will construct a sub-instance X' with a uniform SDP solution and then solve I' using 
Lemma 3.1. To this end, we first construct a partial assignment x u . For every u G X, with probability 
\L u \/d = [d/2\/d, we assign a value to x u uniformly at random from L u ; with probability 1 — 
\L u \/d = \S u \/d, we do not assign any value to x u . Let A = {u : x u is assigned}. Let us say that 
a clause C survives the partial assignment step if for every (u,i) G C either u £ A and i = x u , or 
it ^ ^4 and i G S^. 

The probability that a clause C survives is 

u is assigned value i) j | Pr (x u is unassigned) — 

(u,i)£C,i£L u (u,i)£C,ieS u 

f [d/2\ _j\\°\- r ( c ) /\d/2]\ r{C) _ \d/2] r ^ 
V d ' K2J J \ d J ~ d\°\ ' 

For every survived clause C, let C = {(u,i) : u ^ ^4}. Note that for every (u,i) G C", we have 
i £ S u . We get a sub- instance X' of our problem on the set of unassigned variables {x u : u ^ A} with 
the set of clauses {C : C G C survives}. The length of each clause C equals r(C). In sub-instance 
X', we require that each variable x u takes values in S u . Thus X is an instance of MAX CSP^ 
problem with d! = \S U \ = \d/2~\. 

Now we transform the SDP solution for X to an SDP solution for X': we let zc> = zc for survived 
clauses C, remove vectors ui for all u G A, i G [d] and remove vectors for non-survived clauses 
C. By Claim 4, this SDP solution is a uniform solution for X' (i.e. ||uj|| <l/d' for every u ^ A and 
i & Si; note that X' has alphabet size d'). We run the rounding algorithm from Lemma 3.1. The 
algorithm assigns values to unassigned variables x u . For every survived clause C, we get 

Pr (C is satisfied by x u ) = Pr (C 1 is satisfied by x u ) > mni (ll Zc, ll ) 

_ min(||z C7 || 2 r(C)d / /8,e r ( c ')) min(||z c || 2 |C|d/64, el c l/ 4 ) 
" 2d^ " 2d^ ' 

Therefore, for every clause C, 

Pr (C is satisfied by x u ) > Pr (C is satisfied by x u \ C survives) Pr (C survives) 

min(||z c || 2 |C|d/64,el c l/ 4 ) \d/2] r ^ 
~ 2cT^ X dM 

_ min(||z c || 2 |C|d/64, e l c l/ 4 ) 



2d\c\ 



Finally, we describe an algorithm for clauses C with r(C) < \C\/4. 



□ 
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Lemma 4.3. There is a polynomial-time randomized rounding algorithm that given an MAX CSP^ 
instance X outputs an assignment x u such that every clause C with r(C) < |C|/4 is satisfied with 
probability at least e^ c ^ 8 /d^ c ^ . 

Proof. We do the following independently for every vertex ufl. With probability 3/4, we choose 
x u uniformly at random from L u ; with probability 1/4, we choose x u uniformly at random from 
S u . The probability that a clause C with r(C) < \C\/4 is satisfied equals 

4ILJ -1-1 415 I d \c\ \A\LJJ \A\S U 
1 

- dici 

Note that (|) 3/4 (^pT)) 1/4 > (|) 3/4 (^TTj) 174 > eV8 - Therefore, the probability that the clause 
is satisfied is at least e^ /8 /S c \. □ 

We run the algorithm from Lemma 4.2 with probability 1/2 and the algorithm from Lemma 4.3 
with probability 1/2. Consider a clause C G C. If r(C) > |C|/4, we satisfy C with probability at 

l eas t min(l| 2c f|C|d/64,elg|/4) ^ ff ^ < wg satisfy Q ^ probabmty &t leagt e |C|/8 /(2d |C| ). go 

we satisfy every clause C with probability at least """(ll^cll ^^ 64 ' 2el 7 - 1 . □ 

5 Approximation Algorithm for MAX fc-CSPd 

In this section, we present the main result of the paper. 

Theorem 5.1. There is a polynomial-time randomized approximation algorithm for MAX k-CSPd 
that given an instance T finds an assignment that satisfies at least i?(min (kd, e k ' s )OPT{X)/d k ) 
clauses with constant probability. 

Proof. If d < 113, we run the algorithm of Charikar, Makarychev and Makarychev [3] and get 
f}{k/d k ) approximation. So we assume below that d > 113. We also assume that kd/d k > 1/\C\, 
as otherwise we just choose one clause from C and find an assignment that satisfies it. Thus d k is 
polynomial in the size of the input. 

We solve the SDP relaxation for the problem and run the rounding scheme from Lemma 4.1 d k 
times. We output the best of the obtained solutions. By Lemma 4.1, each time we run the rounding 
scheme we get a solution with expected value at least 

v-^ min(||z c || 2 |C|(i/64,2el c 'l/ 8 ) v-^ min(A;d/64, 2e fe / 8 ) „ ll2 min(A;d/64, 2e fc / 8 ) 

^ 4^ ~h W M " 4d k SDP{1) 

c<=c CeC 

mm(kd/64, 2e k / 8 ) „ 
> L^2 l PT(X). 

Denote a = ram ( kd /^' 2e — ) L e ^ % v^g the random variable equal to the number of satisfied clauses. 
Then E [Z] > aOPT(X), and Z < OPT(X) (always). Let p = Pr (Z < aOPT(X)/2). Then 

p • (aOPT(X)/2) + (1 -p) ■ OPT {I) > E [Z] > aOPT{X). 
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So p < Y~al2 = 1 ~~ ■ ^° w ^ probability at least 1 — p > , we find a solution of value at 
least aOPT(Z)/2 in one iteration. Since we perform d k > l/a iterations, we find a solution of value 
at least aOPT(Z)/2 with constant probability. □ 
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A Proof of Lemma 2.1 

In this section, we prove Lemma 2.1. We will use the following fact. 

Lemma A.l. [see e.g. [2]] For every t > 0, 

2t _£ -. , 2 _£ 
e 2 < 0(tj < e 2 . 



V27r(t 2 + 1) V2nt 
Lemma 2.1. For every t > and (3 G (0, 1], we have 

$(Pt) < ${t) fi2 . 

Proof. Rewrite the inequality we need to prove as follows: ('P(pt)) 1 ^ 2 < <P(t). Denote the left hand 
side by f{(3,t): 

We show that for every t > 0, /(/?, t) is strictly increasing function as a function of (3 G (0, 1]. Then, 

(c2>(/3t))V/3 2 = /(£)< /(i) =<P(t). 
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We first prove that > 0. Write, 



d/3 

df(l t) - - - - - 2te~* 2 / 2 

un ' > = -2 log(<P(t)) <P(t) + fcP'(t) = -2 log(*(t)) <P(t) - 



Consider three cases. If t > \J~^, then, by Lemma A.l, 

$( t ) < _^ e ~* 2 /2 < e -l/2 e -* 2 /2 = e -(* 2 +l)/2_ 



2vr 



= -21og(*(t))«P(t) - 2 *^ r > 2t ^ r x (2p(*(t))*(t) - 1). 



Hence, -21og(<P(i)) > (t 2 + 1), and by Lemma A.l, 

-21og(#(t))#(t)>(t 2 + l)#(t)> 

V ^7T 

2e 



If t < then let p(x) = — logx/(l — x) for x € (0, 1) and write, 

- iog# (t) = Mm ■ (i - #«)) = <« /' > M«(t))te-'V 2 

V27T y_t 

Hence, 



For x G [1/3,1], 2p(x)x > 1, since the function p(x)a; is increasing and p(l/3) > 3/2. Hence 
2p(<P(i))<P(t) > 1, if <P(t) > 1/3. 

The remaining case is t < and # W < 1 / 3 - Then > ^(*) ^ > 1 / 6 and hence 

€ (1/6, 1/3). Since the function — xlogx is increasing on the interval (0,e _1 ), 

-21og(*(t))<P(t)>-21og(l/6)-i>i. 

The function ie~* 2 / 2 attains its maximum at t = 1, thus 

2te-* 2 / 2 2e-V2 i 

We get 

»« M >- -21og(* (i ))#( t )-^>0. 

< 



Since > 0, for every t > 0, there exists £q > 0, such that for all e G (0, £q), /(l — e,t) 



f(l,t). Particularly, for t' = 0t, 

t) = /(l, t'flP 2 > f(l - e, t') 1 ^ = /((l - e)/3, t). 

□ 
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B Improved Approximation Factor for Boolean Max fc-CSP 



In this section, we present an approximation algorithm for the boolean Maximum fc-CSP problem, 
MAX /c-CSP 2 . The algorithm has approximation factor 0.626612 k/2 k if k is sufficiently large. This 
bound improves the previously best known bound of 0.44fc/2 fc [3] (if k is sufficiently large). 

Our algorithm is a slight modification of the algorithm for rounding uniform solutions of MAX 
k-CSPa- We use the SDP relaxation presented in Section 2. Without loss of generality, we will 
assume below that all clauses have length exactly k. If a clause C is shorter, we can introduce 
k — \C\ new variables and append them to C. This transformation will not change the value of the 
instance. 

First, we describe a rounding scheme for an SDP solution {ui,u 2 } ueX u i z c}cec- 

Lemma B.l. There is a polynomial-time randomized rounding algorithm such that for every clause 
C G C the probability that the algorithm satisfies C is at least 



Proof. We round the SDP solution as follows. 



SDP Rounding Scheme for MAX fc-CSP 2 

Input: an instance of MAX /c-CSP 2 and an SDP solution. 
Output: an assignment {x u }. 

— Choose a random Gaussian vector g so that every component of g is distributed as a Gaussian 
variable with mean and variance 1, and all components are independent. 

— For every u G V, let x u = arg maXj(iij, g). 



Consider a clause C G C. We assume without loss of generality that C = {(it, 1) : u G supp(C)}. 
Let 7c = {zc,g) an d lu = {u2 — u\ + zc,g) for u G supp(C). Note that for u G supp(C), 

Var[ 7c; ] = \\z c \\ 2 = (3 2 /k, 

Var[7 u ] = ||it 2 - ui + z c \\ 2 = \\ui\\ + ||ti 2 || 2 + ||^c|| 2 - 2(ui, z c ) = \\ui\\ + ||u 2 || 2 - ||^c|| 2 < 1, 
K [iclu] = {zc,U2 -ui + z c ) = {zc,u 2 ) - {zc,ui} + {zc,z c ) = - \\z c \\ 2 + l^cll 2 = 0. 

Therefore, all random variables 7„, for u G suppC, are independent from 7c. The probability that 
C is satisfied equals 

Pr(C is satisfied) = Pr((ui,g) > (u2,g) for every u G supp(C)) 

= Pr (7c > 7« for every u G supp(C)) > Pr (|7„| < 7c for every u G supp(C)) 
= E 7c I Pr (iTuI < 7C* for every u G supp(C) | 7c)] 




and (3 = \fk 1 1 1 1 2 - 




Pr (|7„| < 0t for every u G supp(C)) e~ kt2/2 dt. 
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We use here that Var[ 7 c//3] = l/k. By Sidak's Theorem (Theorem 2.1), we have 



Pr (| 7 «| < fit for every u € supp(C)) > [] Pr (| 7tt | < fit) = [J <P(/ft/VVar[ 7u ]) 

«ssupp(c) «esupp(c) 

> n #(^) = <p(/3t) k . 



«Gsupp(C) 



We conclude that 



1 f°° 

Pr(C is satisfied) > / hp(t) k dt. 

2 k y2Tik Jo 



□ 



Let g((3) = max te n hp(t) (hp(t) attains its maximum since hp(t) — > as t — > oo). Note that g{fi) 
is an increasing function since hp(t) is an increasing function of f3 for every fixed t. Additionally, 
g{0) = and lim^^ g(p) = 2 since /(/3, l/y/fi) = 2<P(^) e - 1 ^ 2 ^ -> 2 as /3 -> oo, and for every 
(3 and t, f(P,t) < 2. Therefore, /3 _1 is defined on [0,2). Let (3o = g~ l (\). It is easy to check 
numerically that /3 G (1.263282, 1.263283). 



~i 1 1 1 

8.5 9 9.5 10 



0.5 1 1.5 



Fig. 1. The figure shows the graph of g(t). We note that g{t) > 1 when Oftw 1.263282. 



Claim. For every f3 > (3q there exists ko (which depends only on /3) such that if k > ko and 
Ike 1 1 > (3/Vk then the probability that the algorithm from Lemma B.l returns an assignment that 
satisfies C is at least k 2 /2 k . 

Proof. Let E\ = (g((3) — l)/2 > 0. Let £2 be the measure of the set {t : hp(t) > 1 + £1}. Since hp(t) 
is continuous, £2 > 0. 

The probability that C is satisfied is at least 



1 



^^2(l + £l) fe 



hp{tfdt > 



2 k ^/2jtk 



2 k ^f2vk Jo 
We choose ko so that for every k > ko 

e 2 (l + £i) fc > \[2^k-k 2 . 
Then if k > ko the probability that the clause is satisfied is at least k 2 /2 k . 
Now we are ready to describe our algorithm. 



□ 
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Theorem B.l. There is a randomized approximation algorithm for the boolean MAX k-CSP prob- 
lem with approximation guarantee akk/2 k where — > «o > 0.626612 as k — > oo and ao = 1 / /3g . 
(Here, as above, (3q is the solution of the equation g(j3) = 1 where g((3) = max tG R 2<P(f3t)e~ t I 2 .) 

Proof. The algorithm with probability p = 1/k rounds the SDP solution as described in Lemma B.l, 
with probability 1 — p, it choses a completely random solution. 

Let a < ao- We will show that if k is large enough, every clause is satisfied with probability 
at least ak/2 k . Let f3 = (f3 + q _1 / 2 )/2 G (/^a™ 1 / 2 ). Let ko be as in Claim B. Suppose that 
k > max(/c , (1 - a/3 2 ) -1 ). 

Consider a clause C. We show that the algorithm satisfies C with probability at least ^0 k . 
Indeed, we have: 

— If \\zc\\ < P/Vk, the clause is satisfied with probability at least (1 — p)/2 k > ^"^Jlf^ > 
a\\z c \\ 2 k/2 k . 

— If || zc 1 1 > (3/Vk, the clause is satisfied with probability at least p ■ k 2 /2 k = k/2 k > k \\zc\\ 2 /2 k . 
We conclude that the algorithm finds a solution that satisfies at least 

ctk v — \ „ „ 9 afc a/c 

clauses in expectation. By running this algorithm polynomially many times (as we do in Theo- 
rem 5.1) we can find a solution of value at least a'kOPT /2 k for every constant a' < a w.h.p. □ 
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